View Issue Details

IDProjectCategoryView StatusLast Update
0000530T99X171.00 SKB EagleSWpublic2019-04-17 00:04
Reporter(ALTech) SY Yoon Assigned To(SW) Jason LingDue Date2019-03-08 12:45
PriorityhighSeveritys2-severeReproducibilityhave not tried
Status closedResolutionfixed 
Summary0000530: Google CTS certification pre-testing based on AML Android P BSP
DescriptionTV Storm asked to provide Google certification test result as follows.
1. Amlogic have certified with Android P from Google.
    TV Storm asked us to provide their waiver list on certification.
2. I think Foxconn will do Google certification test internally.
    TV Storm asked us to provide your test result.
    TV Storm will do Google certification test internally with their SW.
    So they need to know what kinds of issues that AML SDK has. It is helpful to distinguish the cause of issues.
    TV Storm will not review the issues that listed in AML SDK issues.
    TV Storm will focus on other issues that their SW make.
TagsNo tags attached.
Attach Tags

Users monitoring this issue

User List (ALTech) Eric Kim , (ALTech) Jewoo Lee

Activities

(SW) Jacky Chiang

2019-03-06 19:05

manager   ~0001368

We found CTS report is not clean based on current FW and is checking with AML what's problem on this.

(SW) Jacky Chiang

2019-03-12 20:37

manager   ~0001472

Hi Jason,

   Please provide the CTS/GTS/VTS failed issues which we are working on.

(SW) Jason Ling

2019-03-13 12:00

developer   ~0001490

CTS 9.0_r6: Clean (exclude wifi items), but we are making media test modules more stable now
1. android.permission2.cts.PrivappPermissionsTest#testPrivappPermissionsEnforcement (This is GTVS packages issue, I think it can be waived)
2. android.security.cts.VerifiedBootTest#testVerifiedBootSupport (Fix, Apply in DVT)
3. android.security.cts.EncryptionTest#testEncryption (Amlogic think this item can be waived)

CTS-Verifier: 2 Fail (exclude wifi items)
1. manualTests#com.android.cts.verifier.audio.HifiUltrasoundSpeakerTestActivity (still work on)
2. manualTests#com.android.cts.verifier.bluetooth.BluetoothTestActivity (still work on)

GTS 6.0_r3: Clean (exclude wifi items)
1. noDisambig_onLongPressHome (Amlogic think this item can be waived)
2. testNonApiReferences (Amlogic think this item can be waived)
3. testEcAttestationChain (Fix, Apply in DVT)
4. testRsaAttestationChain (Fix, Apply in DVT)

VTS 9.0_r5: Clean (exclude wifi items)

CTS-on GSI 9.0_r5: Clean (exclude wifi items), but we are making media test modules more stable now
1. android.bluetooth.cts.BluetoothLeScanTest#testBasicBleScan (Amlogic think this item can be waived)
2. android.bluetooth.cts.BluetoothLeScanTest#testScanFilter (Amlogic think this item can be waived)
3. android.signature.cts.api.HiddenApiTest#testSignature (Amlogic think this item can be waived)
4. android.signature.cts.api.DebugClassHiddenApiTest#testSignature (Amlogic think this item can be waived)
5. libcore.libcore.icu.DateIntervalFormatTest#testEndAtMidnight (Amlogic think this item can be waived)
6. android.security.cts.EncryptionTest#testEncryption (Amlogic think this item can be waived)

(ALTech) Eric Kim

2019-03-14 10:31

developer   ~0001519

Hi Jason,

Please let us know what is AML's BSP version on above test result.
We would be grateful if you could update the test result and version name herer whenever AML's BSP version would be changed.

(SW) Jason Ling

2019-03-14 15:40

developer   ~0001523

Hi Eric,

We used AML openlinux 2019-0111 for CTS Testing.
We used the same BSP Version as TVS.

(ALTech) Eric Kim

2019-03-14 16:54

developer   ~0001526

Hi Jason,
Thanks for your feedback.

Hi SY Yoon

I think these results and information are enough for us.
Please review it if more information is necessary

(ALTech) SY Yoon

2019-03-19 20:51

developer   ~0001608

Hi Jacky,
This is a test result of AML 2019/1/11 version. Now we have many changes on AML SDK.
I think they test newer version last week.
I attached their test. They use 2019/3/3 version.
Please refer about it.
And I would like to know Foxconn will test again with new AML SDK later ?
Or will foxconn test with our SW(include TVS) ?

(SW) Jason Ling

2019-03-20 14:44

developer   ~0001642

Hi SY Yoon,

In last stage (Our test firmware is based on AML 2019/01/11)
We still have 3 fail items in CTS (exclude wifi items and waived items)
1. android.media.cts.DecodeAccuracyTest (not stable, so we work with AML to solve it)
2. testCastV2Signer (Need Google to active this model for Casting)
3. BluetoothHID test in CTSVerifier (still work on)

In next stage,
We are planning to test the firmware based on (AML 2019/01/11 + AML patch to0303 + Foxconn driver/HAL for SKB).

In addition, Google update the test tool last week, so in next stage, we will use
CTS 9.0_r6
GTS 6.0_r4 (update)
VTS/CTS-on-GSI 9.0_r6 (update)

(ALTech) SY Yoon

2019-04-17 00:04

developer   ~0002033

If SKB or TVS ask it, then I will reopen it.

Issue History

Date Modified Username Field Change
2019-03-01 11:53 (ALTech) SY Yoon New Issue
2019-03-01 11:53 (ALTech) SY Yoon Status new => assigned
2019-03-01 11:53 (ALTech) SY Yoon Assigned To => (SW) Jacky Chiang
2019-03-01 11:54 (ALTech) SY Yoon Issue Monitored: (ALTech) Eric Kim
2019-03-01 11:54 (ALTech) SY Yoon Issue Monitored: (ALTech) Jewoo Lee
2019-03-06 19:00 (SW) Jacky Chiang Assigned To (SW) Jacky Chiang => (SW) Jason Ling
2019-03-06 19:05 (SW) Jacky Chiang Note Added: 0001368
2019-03-12 12:36 (SW) Jacky Chiang Summary Google test with Amlogic SDK level => Google CTS certification pre-testing based on AML Android P BSP
2019-03-12 20:37 (SW) Jacky Chiang Note Added: 0001472
2019-03-13 12:00 (SW) Jason Ling Note Added: 0001490
2019-03-14 10:31 (ALTech) Eric Kim Note Added: 0001519
2019-03-14 15:40 (SW) Jason Ling Note Added: 0001523
2019-03-14 16:54 (ALTech) Eric Kim Note Added: 0001526
2019-03-19 20:46 (ALTech) SY Yoon Assigned To (SW) Jason Ling => (SW) Jacky Chiang
2019-03-19 20:51 (ALTech) SY Yoon File Added: GTVS_Test_result-20190303.zip
2019-03-19 20:51 (ALTech) SY Yoon Note Added: 0001608
2019-03-20 14:44 (SW) Jason Ling Note Added: 0001642
2019-03-21 09:54 (SW) Jacky Chiang Assigned To (SW) Jacky Chiang => (SW) Jason Ling
2019-04-17 00:04 (ALTech) SY Yoon Status assigned => closed
2019-04-17 00:04 (ALTech) SY Yoon Resolution open => fixed
2019-04-17 00:04 (ALTech) SY Yoon Note Added: 0002033